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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1 .313 and MPEP 1 308. 



j This communication is responsive to BPAI decision of 8/9/10 . 
] The allowed claim(s) is/are 4,5,7-18 and 27 . 



3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) Q including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . ^ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 10/30/01 5/23/03 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. ^ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 



/Brian P. Werner/ 

Primary Examiner, Art Unit 2624 
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DETAILED ACTION 
EXAMINER'S AMENDMENT 

1 . An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .31 2. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Jared Engstrom, Reg. No. 58,330 on 11/16/10. 
The application has been amended as follows: 
In claim 4, line 1 change "a computer-readable medium" to 
--a non-transitory computer-readable medium- 

Claim Rejections - 35 USC § 101 

2. Due to the BPAI decision on appeal of 8/9/1 0, the method claims 1 3 and 1 6 are 
eligible under 35 USC 1 01 , because the BPAI decision on page 4, FINDINGS OF FACT 
section, paragraph 1 states that "the... method for automatically generating image meta- 
data from digital images using at least one predefined image analysis algorithm" which 
means that the method is not a manual process, but a automated method. 
Paragraph 2 further describes the algorithm. Paragraph 3 states that "other types of 
information about image data can be manually input by the user without needing. ..a 
predefined image analysis algorithm, including the... location of where the image was 
captured." Thus, the claimed image analysis algorithm of claims 13 and 16 is automated 
by hardware as one of ordinary skill in the art would know and is not a manual process 
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and has been separated by the Board via the finding of facts from a manual 
embodiment. 

Claim Rejections - 35 USC §112 

3. Due to the BPAI decision of 8/9/1 0 on page 7, 1 st sentence, the 1 1 2 rejection is 
withdrawn. 

Claim Rejections - 35 USC § 102 

4. Due to the BPAI decision on pages 7, last paragraph, 1 st sentence and page 8, 
lines 2-5, the 102 rejection is withdrawn. 

Claim Rejections - 35 USC § 103 

5. Due to the BPAI decision on pages 8 and 9, the 1 03 rejection is withdrawn. 

Allowable Subject Matter 

6. Claims 4,5,7-1 8 and 27 are allowed. 

7. The following is an examiner's statement of reasons for allowance: 

Claims 4,5,7-18 and 27 are allowed, because "Wang does not disclose each and 
every feature of the claim (App. Br. 9)" in page 7, last paragraph, 1st sentence of the 
BPAI decision on appeal and "Wang is silent as to an image analysis algorithm that 
identifies a recognized location, wherein the location is geographical, i.e., where the 
image was captured" in the BPAI decision on page 8, lines 2-5. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

8. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Toyama et al. (US Patent 7,068,309) is pertinent as teaching "The Location on 
Earth where the Image was Taken" in col. 13, line 12 and teaching "face recognition" in 
col. 5, lines 1 -5 and metadata with location. However, Toyama does not teach meta- 
data created by applying a predefined image analysis algorithm to the digital image data 
to identify within the image a recognized location at which the image was captured. 
Instead, Toyama teaches that a user enters the location or the location information is 
external to the image such as GPS to create metadata. 

Lange et al. (US Patent 6,760,491 ) is pertinent as teaches that "location" (col. 1 , 
lines 36-39) is an example of a notation, the location is also an example of "metadata" in 
col. 3, lines 19-21, "text data associated with the digital image may be considered 
metadata, containing information pertinent to the image, such as location" in col. 3, lines 
19-21 and performs OCR (object character recognition), fig. 4:404 or 408, to the text to 
create text data that may be considered as metadata. However, the OCR is done on the 
text or notation written on the back of a photo and not on the other side of the photo that 
actually has the picture of a scene or location. Thus, for Lange to anticipate the claims, 
Lange has to identify the location of the captured OCR text data and create metadata 
from the captured OCR text data that may have a location of the captured OCR text 
data. 
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Shaffer et al. (US Patent 6,389,181) is pertinent as teaching an image 
understanding algorithm in fig. 3:68 that "correlatefs] known location scenes with the 
image content from available images 32" in col. 8, lines 30-36. However, the 
understanding algorithm does not create metadata and instead creates annotation data. 

Wactlar (Informedia - Search and Summarization in the Video Medium) is 
pertinent as teaching video OCR that is able to determine a "location of the scene and 
event depicted" in page 2, last paragraph, first sentence and teaches a metadata 
extractor in fig. 4 that shows the location being extracted from the video. Note that this 
reference does not clearly have a publisher and does not clearly establish when this 
document was available to the public. 

Wactlar (New Directions in Video Information Extraction and Summarization) is 
pertinent for similar reasons as the 1st Wactlar reference above. Note that this 
reference does not clearly have a publisher and does not clearly establish when this 
document was available to the public. 

Wactlar (Multi-Document Summarization and Visualization in the Informedia 
Digital Video Library) is pertinent for similar reasons as the 1st Wactlar reference above. 

Note that this reference does not clearly have a publisher and does not clearly 
establish when this document was available to the public. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DENNIS ROSARIO whose telephone number is 
(571)272-7397. The examiner can normally be reached on 9-5PM. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on (571)272-7778. The fax phone number 
for the organization where this application or proceeding is assigned is 571 -273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Dennis Rosario 
Examiner 
Art Unit 2624 



/Brian P. Werner/ 

Primary Examiner, Art Unit 2624 



